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ABSTRACT 

\ 

V 

In  this  paper  we  consider  an  adaptive  approach  for  estimating  reliability 
growth,  based  on  prior  information  which  is  motivated  from  practical 
considerations.  We  discuss  two  situations:  in  the  first  one,  both  the 
prior  distribution  and  the  posterior  distributions  of  the  mean  time  to 
failure  of  an  exponential  distribution  are  stochastically  ordered;  in 
the  second  situation,  the  prior  distribution  is  stochastically  ordered 
with  respect  to  the  last  posterior  distribution.  The  former  situation 
leads  us  to  a  procedure  which  is  not  fully  Bayesian,  and  is  therefore 
termed  by  us  as  ."pseudo-Bayesian."  Since  we  do  not  know  the  properties 
of  this  pseudo  Bayesian  approach,  we  can  best  describe  our  work  here  as 
being  a  "pseudo-Bayesian  scheme. u‘  The  second  situation  leads  us  to  an 
approach  which  is  fully  Bayesian  under  certain  assumptions.  Our  work 
in  this  general  area  of  reliability  growth  is  still  in  progress,  and  we 
invite  the  attention  of  other  researchers  to  look  into  some  of  the  prob¬ 
lems  that  we  have  posed,  and  the  questions  that  we  have  raised^ 


AN  ADAPTIVE  BAYESIAN  SCHEME  FOR  ESTIMATING  RELIABILITY 
GROWTH  UNDER  EXPONENTIAL  FAILURE  TIMES 


by 

Nozer  D.  Singpurwalla 


1.  INTRODUCTION 

A  complex,  newly  designed  system,  generally  undergoes  several  stages 
of  testing  before  it  is  put  into  operation.  After  each  stage  of  testing, 
changes  are  made  to  the  design  (or  the  operating  conditions  are  re¬ 
specified)  with  the  hope  that  the  new  design  would  lead  to  a  longer  period 
of  performance.  This  procedure  is  referred  to  as  "reliability  growth"; 
this  is  because  a  longer  period  of  performance  implies  an  improvement 
in  reliability.  Often,  in  practice,  a  change  in  the  system  design  may 
result  in  a  deterioration  of  the  system  performance,  so  that  the  term 
reliability  growth  may  not  be  an  appropriate  description  of  what  is 
actually  happening  to  the  system.  However,  since  the  intent  of  a  design 
change  is  to  improve  the  reliability,  we  shall  continue  to  use  the  term 
reliability  growth  throughout  this  paper. 

Suppose  then,  that  the  system  has  been  tested  at  stages  0,1,2,  ....  t 
At  the  end  of  each  stage,  an  estimate  of  the  reliability  of  the  system  is 
made  using  any  of  the  conventional  procedures  which  measure  the  reliability 
of  the  system.  At  each  stage  of  testing,  we  may  test  either  a  single 
copy  of  the  system,  or  several  copies  of  the  system,  depending  on  the 
particular  situation  being  considered.  Having  tested  the  system  over 
(r  +  1)  stages,  we  would  like  to  know  the  following: 


i)  Has  there  been  a  genuine  growth  in  reliability  over  the 
time  period  covered  by  the  (t  +  1)  stages  of  testing, 
and  is  this  growth  significant? 

ii)  Using  all  the  testing  information  that  we  have  acquired 
over  all  of  the  stages,  what  is  our  best  (in  a  sense  to 
be  made  precise  later  on)  estimate  of  the  reliability 
of  the  system  at  stage  t? 

An  answer  to  question  i)  will  enable  a  decision  maker  to  determine 
if  indeed  the  design  changes  do  result  in  an  improvement  in  reliability, 
and  perhaps  determine  the  rate  (with  respect  to  the  stages)  at  which 
there  is  a  growth  in  reliability.  An  answer  to  question  ii)  will  enable 
a  decision  maker  to  decide  if  the  system  is  ready  to  be  put  into  operation, 
and  to  arrive  at  a  suitable  cost-warranty  agreement  with  the  user.  We 
can,  of  course  envision  several  other  uses  of  the  analysis  described  in 
i)  and  ii)  above. 

Since  1966,  there  have  been  several  papers  written  under  the  heading 
of  reliability  growth,  each  emphasizing  a  different  point  of  view.  For  a 
recent  survey  of  these  papers,  we  refer  the  reader  to  H.  Balaban  (1978). 

The  approach  that  we  shall  take  in  this  paper  is  Bayesian,  with  our 
Bayesian  analysis  being  undertaken  in  a  manner  which  will  be  described 
in  Section  2.  Others  who  have  adopted  a  Bayesian  point  of  view,  but  with 
a  direction  different  from  ours  are  A.F.M.  Smith  (1977)  and  Weinrich 


and  A.  Gross  (1978). 
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2.  A  BAYESIAN  SCHEME  FOR  ESTIMATING  RELIABILITY  GROWTH 

We  shall  start  off  by  considering  the  following  model: 

Suppose  that  the  failure  distribution  of  the  system  after  the  i1"*1 
design  change,  i  *  0,1,  ...,  t  ,  is  an  exponential  distribution  with  a 
mean  6^  .  That  is 

1 

f <t;ei)  *  q~  e  .  6i  >  o  ,  t  >  o  . 

In  particular,  at  stage  0,  when  the  system  is  newly  built,  its  time  to 
failure  is  an  exponential  distribution  with  mean  0^  .  Based  upon  our 
previous  knowledge  of  the  mean  time  to  failure  of  similarly  designed  systems, 
we  shall  assign  a  prior  distribution  to  8q  ,  say  GO^;*)  .  Without  any 
loss  in  generality,  we  shall  let  G(8Q;»)  be  the  natural  conjugate  prior, 
which  in  this  case  is  an  inverted  gamma  distribution,  with  parameters  aQ 
and  8q  that  is 


(2.0)  dG(60;->  *  g 


0  I 

(90;a0,!V  “  r(80)  (ejj) 


S°+1  -V9o 

e  ,  for  a0  ,  S0  ,  0O  >  0 


It  is  easy  to  verify  that  the  prior  mean  is 


E(V  ‘  <  -  ■  1£  6o  - 1 ; 

thus  we  shall  require  that  8q  >  1  . 

Having  assigned  our  prior  distribution  G(9q;*)  ,  we  shall  test 
Oq  (>_  1)  copies  of  the  system,  and  observe  their  times  to  failure. 


k 


C0,i  *  1  “  1,2‘  •***  n0  ’  Let  T0 

total  time  on  test. 


It.., 

i-1  ,X 


be  the  observed 


Conditioned  on  Tg  ,  the  posterior  distribution  of  6g  under  the 
inverted  gamma  prior  is  also  an  inverted  gamma.  That  is 


dG<90  ^  T0:*>  “  S(90  1  T0:0l0,60,n0^ 


<“0  +  VSo%  ,  1  >rt°+1  -<VV/eo 


The  mean  of  the  posterior  distribution  of  6  ,  is 


E(9  It)*  — Ct°  +  -T° — 

'  0  1  V  60  +  nQ  -  1 


The  above  quantity  is  our  Bayes  estimate  of  the  mean  time  to  failure 
at  stage  0,  based  on  the  prior  distribution  g(9g;ag,8g)  ,  the  total  time 
on  test  Tg  ,  and  assuming  a  squared  error  loss  function.  A  posterior 
(1  -  y)%  credibility  interval  for  9g  can  be  obtained  by  finding  two 
numbers  (9Q  |  TQ)  and  (9g  J  Tg)  such  that 


‘W 


g(eo  i  V  Wno)deo  -  (1  -  Y)  • 


The  parameter  9q  and  its  posterior  distribution  is  a  natural  measure 
of  the  performance  of  the  system  at  stage  0.  Having  observed  the  mean  of 


the  posterior  distribution  of  9q  ,  we  may  want  to  increase  it  by  making 
either  design  changes  or  re-specifying  the  operating  conditions  of  the  system. 
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Suppose  that  we  do  decide  to  make  these  changes;  let  9^  denote  the  mean 
time  to  failure  after  the  changes  have  been  made.  The  system  is  now  at 
stage  1,  and  we  are  ready  to  test  the  system  and  verify  if  the  changes 
have  resulted  in  an  improvement  of  the  system. 

Since  we  have  adopted  a  Bayesian  point  of  view,  our  first  task  is 
to  choose  a  prior  distribution  for  0^  ,  say  G  ( 9^ ;  * )  .  The  novelty  of 
our  approach  pertains  to  the  manner  in  which  we  go  about  choosing  G(9  ;•)  , 
and  this  is  motivated  by  the  following  consideration: 

Even  though  the  changes  that  we  have  instituted  have  been  undertaken 
with  a  view  towards  increasing  the  reliability  of  the  system,  there  is 
a  possibility  that  the  changes  could  be  deleterious  to  the  system.  In 
order  to  account  for  this  possibility  we  shall  choose  G(9  ;•)  in  such 

a  manner  that  9^  is  stochastically  larger  than  (0Q  |  TQ)  ;  this  is 

S  t  I 

written  as  9^  >_  (0Q  [  TQ)  .  Thus,  we  must  have 

p(01  >  x)  >  P((0Q  |  T  )  >_  x)  ,  for  all  x  >_  0  . 

The  usual  strategy  for  situations  of  this  type  is  to  take  9^  >_  (9q  |  Tq) 

with  probability  1,  as  has  been  done  by  Barlow  et  al.  (1972)  and  by 
Smith  (1977).  However,  a  prior  chosen  to  satisfy  the  above  condition  does 
not  place  any  mass  in  the  region  9^  <  (0q  |  Tq)  ,  and  therefore  would 
exclude  from  our  analysis  the  possibility  of  an  adverse  effect  of  the 
changes.  Hence,  for  the  situation  that  we  are  considering  here,  the 

S  t  I 

requirement  that  9^  >_  (9q  |  Tq)  makes  more  practical  sense. 

Following  our  previous  discussion,  suppose  that  the  prior  distribution 
G ( 9 ^ ; * )  is  also  an  inverted  gamma  with  parameters  oi^  and  .  That 
is. 
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(2.4)  00(9^.)  -  s<WBi>  -r^y(i) 


61+1  -V91 

1  e 


al  ’  61  ’  91  >  0 


A  sufficient  condition  for  ensuring  that  0^  Sf  (9^  |  T^)  is  to  have 
at ^  «Q  +  Tq  ,  and  =  8q  +  n^  .  Verify  that  under  the  above  conditions 
E(0^)  >_  E(9g  1  Tg)  ,  a  condition  that  we  would  hope  to  achieve  under  the 
hypothesis  that  a  change  is  beneficial  to  the  system.  A  natural  strategy 
is  to  choose  =  <Xq  +  +  a^  ,  where  the  value  of  a^  reflects  our 

prior  belief  about  the  magnitude  of  the  improvement  in  the  mean  as  a  result 
of  the  changes.  When  is  thus  chosen,  it  is  important  that  at  stage  1 

we  treat  as  being  a  constant.  If  this  is  not  done,  then  the  posterior 

distribution  of  9^  will  have  to  be  obtained  by  treating  a.  as  a  hvper- 
parameter  with  a  prior  distribution  which  is  related  to  the  unconditional 
distribution  of  TQ  .  Under  the  above  circumstances,  the  posterior  dis¬ 
tribution  of  9^  will  not  be  an  inverted  gamma,  and  our  procedure  will 
become  computationally  involved.  Furthermore,  we  shall  also  assume  that 
g01;a1,31)  is  independent  of  g(9Q  |  TQ;*)  . 

Having  chosen  g(9^;a^,g^)  ,  we  test  n^  >_  1  copies  of  the  system 
(under  stage  1),  and  observe  ,  the  corresponding  total  time  on  test. 

Since  we  have  taken  to  be  a  constant  (once  we  are  at  stage  1)  the 

posterior  distribution  of  0^  conditioned  on  is 


(2.5)  g(0. 


T  •  • ) 
1’  ; 


(ao  +  To  +  ai  +  T1) 


Wni 


,(80  +  n0  +  nl) 


VW1  -(VVW 

e 


with  the  parameters  having  the  usual  positive  signs. 
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Because  of  independence,  and  under  Che  assumption  of  a  squared  error 
loss,  the  Bayes  estimator  of  9^  is  the  mean  of  the  posterior  distribution 
of  9^ 


(2.6) 


E(9, 


V 


aQ  +  T0  +  al  +  T1 

6o  +  no  +  ni  '  1 


Under  our  postulate  of  reliability  growth,  we  would  want  to  have 


_  .  st 
T  )  1 


(0, 


T  ) 
O' 


a  necessary  (though  not  sufficient)  condition  for  the  above  inequality 
is  that 


(2.6.1) 


a0  +  T0  +  al  +  T1  >  aO+T0 
S0  +  n0 


ni  “  1  ~  6o  +  no  “  1  ’ 


which  reduces  to  the  requirement  chat 


(2.7) 


al  +  T1  >  ao  +  T0 


30  +  n0  “  1 


If  Equation  (2.7)  is  not  satisfied,  we  proceed  to  Section  2.1  and  follow 
the  strategies  discussed  there.  If  Equation  (2.7)  is  satisfied,  then 


we  can  either  use  E(9^  |  T^)  as  our  Bayes  estimator  of  9^  ,  with  a 
(1  -  y)%  credibility  interval  for  6^  given  by  the  two  numbers 


(9i  |  T^)  and  (9^  I  T^)  such  that 


<eilV 


/ 


g(e. 


T1;-)d91  =  1  -  y  , 


■ 
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and  stop,  or  we  can  proceed  to  stage  2  by  making  the  appropriate  modifica¬ 
tions  to  the  system. 

If  we  proceed  to  stage  2,  then  the  prior  distribution  of  0^  should 
be  such  that 


(2.8) 


0., 


st 


2  - 


(0,  1 


V 


One  way  of  achieving  Condition  (2.8)  is  to  choose  or,  and  8.,  , 
the  parameters  of  the  inverted  gamma  prior  distribution  of  0.,  In  such 
a  manner  that  a,,  »  +  TQ  +  a^  +  +  a.,  and  8.,  -  8  +  n^  +  . 

As  before,  a,,  reflects  our  belief  about  the  magnitude  of  the  improvement 
in  the  mean  as  a  result  of  the  changes,  and  and  Tj  are  now  assumed 

to  be  constants.  We  shall  continue  with  our  discussion  of  this  strategy 
in  Section  2.2. 


2.1  Procedures  When  the  Posterior  Distributions  at  Stages  0  and  l_ Arc  Not 
Stochastically  Ordered 

If  Equation  (2.7)  is  not  satisfied,  that  is,  if 


(2.9) 


;‘l  +  T1 


*0  +  To 
*0  +  no  ■ 


a. id  if  we  have  >;<>  reason  to  believe  that  the  reliability  growtli  postulate 
may  not  be  true,  then  we  conclude  that  the  Inequality  (.2.9)  is  brought 
about  bv  the  randomness  In  observing  and  .  In  order  to  recti ly 

this,  we  propose  two  strategies,  each  having  Its  own  peon  lari t ies : 


l : 


Ignore  the  inequality  (.2.9),  and  j'or  t  ho 
that  E ( 0 1  |  T  )  •  E(00 


'  n.i  accept  the  result 


T(j)  ;  proceed  to  stage  2,  bv  choosing  the  prior 
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distribution  of  62  in  such  a  manner  that  Equation  (2.8)  is  satisfied. 
After  completing  the  testing  over  all  the  t  +  1  stages,  we  will  perform 
an  isotonic  regression  of  the  posterior  means;  this  will  be  discussed 
in  Section  3. 


Strategy  2: 

By  ignoring  the  inequality  (2.9)  and  directly  proceeding  to  stage  2, 
we  will,  through  the  prior  distribution  of  62  ,  allow  the  effects  of 
(2.9)  to  perpetuate  over  the  succeeding  stages.  We  can  avoid  this  by 


pooling  the  violators 

To 

and 

T1 

and 

also 

the 

no 

and 

nl 

•  we  replace  both 

To 

and 

T1 

by 

T 

01 

def 

To  + 
2 

h 

9 

and 

•  we  replace  both 

no 

and 

nl 

by 

O 

C 

def 

no  + 
2 

If  we  pool  as  above,  then,  we  must  test  to  see  if 


(2.10) 


al  +  T01  >  a0  +  T01 


01 


8o  +  noi  '  1 


which  is  a  condition  analogous  to  (2.7)  except  that  the  n^  and  the  T  , 
i  *  0,1  ,  have  been  replaced  by  their  pooled  values.  Since  (Sq  -  1)  >  0  , 
a  condition  which  is  needed  to  ensure  that  the  mean  of  the  prior  distribution 
of  0Q  is  finite,  a  sufficient  condition  for  (2.10)  is  that 


To  summarize,  we  must  choose  a^  >_  ag  >  and  if  the  inequality  (2.7) 


is  violated,  then  we  shall  pool  and  be  ensured  that 


10 


(2.11) 


a0  +  T01  +  al  +  T01  >  a0  +  T01 


60  +  n01  +  noi  *  1  Bo  +  noi  '  1  ’ 


in  lieu  of  our  original  requirement  that 


ao  +  To  +  ai  +  T1  >  ao  +  To 


00  +  n0  +  ni  ~  1  —  3q  +  nQ  ~  1 


Since  Equation  (2.11)  can  also  be  written  as 


(2.12) 


aQ  +  TQ  +  Tl  +  ax  2aQ  +  TQ  +  ^ 


B  +  n  +  n  -  1  —  28q  +  nQ  +  n^  -  1  * 


and  since  the  left  hand  side  of  the  above  equation  is  identical  to  the 
left  hand  side  of  Equation  (2.6.1),  the  effect  of  pooling  is  to  lower  the 
magnitude  of  the  right  hand  side  of  (2.6.1).  Recall  that  the  right  hand  side 
of  (2.6.1)  is  the  posterior  mean  of  8Q  given  TQ  .  Thus ,  the  effect  of 
pooling  is  to  lower  the  posterior  mean  at  the  previous  stage  in  the  light 
of  the  information  obtained  at  the  current  stage ,  the  previous  stage, 
and  the  prior  assumption. 

Thus,  our  revised  Bayes  estimator  of  8Q  is 


(2.13) 


E(0, 


vv 


2a0  +  T0  +  T1 
2Sq  +  nQ  +  ni  -  1  » 


and  the  revised  credibility  intervals  for  9^  are  given  by 


/  s(9o  I  VV)deo  ■  1  -  ’ 


‘VW 


where  g ( 8q  |  T^.T^;*)  is  an  inverted  gamma  distribution  with  a  scale 
parameter  (2oIq  +  +  T^)/2  and  a  shape  parameter  (28q  +  n^  +  n^)/2  . 

Our  Bayes  estimator  of  8^  remains  unchanged  and  is  given  by 


(2.14) 


a  +  T  +  T  +  a 

EWi  l  V  -  frrJhr'  ~r~r 


with  credibility  intervals  given  by  the  procedure  which  follows  Equation 
(2.7). 

We  can  stop  at  this  point,  or  proceed  to  stage  2  by  choosing  an 
inverted  gamma  prior  distribution  of  with  prior  parameters  a ^  and 

&2  where  +  TQ  +  +  a^  +  anc*  ^2  =  ^0  +  n0  +  °1  ’ 

Tq  and  treated  as  being  constants. 

2.2  Analysis  of  Failure  Data  at  Stage  2 

We  have  seen  before,  that  irrespective  of  whether  condition  (2.7) 
is  satisfied  or  not,  the  prior  distribution  of  8^  will  be  an  inverted 
gamma  with  parameters  02  and  82  »  where 


(2.15)  a2  =  a0  +  T0  +  al  +  T1  +  a2  and  =  S0  +  n0  +  °1  ' 

Having  chosen  g(82;ct2,B2)  .  we  test  n2  1  copies  of  the  system 
(under  stage  2),  and  observe  T2  the  corresponding  total  time  on  test. 
If  g^;*^^)  is  assumed  to  be  independent  of  g(0^  |  T^;*)  >  then 
the  posterior  distribution  of  82  given  is  also  an  inverted  gamma 

with  parameters  (<Sq  +  Tq  +  a^  +  +  82  +  T2)  and  (Bq  +  n^  +  n^  +  n?) 

Here  again,  in  order  to  be  assured  that 
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(02  |  T2)  (01  | 


we  shall  need,  as  a  necessary  condition. 


(2.16) 


a2  +  T2  >  a0  +  T0  *  al  *  T1 
n2  1  e0  +  n0  +  "l  '  1 


If  condition  (2.16)  is  satisfied,  then,  we  can  either  stop  and  because 
of  the  independence  assumption  use  (Og  +  Tg  +  a^  +  +  a2  +  T2)/ 

(Bg  +  n^  +  n^  +  n2  -  1)  as  our  Bayes  estimator  of  ©2  ,  with  a  100(1  -  y)% 
credibility  interval  for  02  given  by  the  two  numbers  (92>T2)  and  (92>T2) 
such  that 

(®2,T2) 

J  g(02  j  T2;-)d02  -  1  -  y  , 

(®2’T2) 

or  we  can  proceed  to  stage  3  by  making  the  appropriate  modifications  to  the 
system.  If  we  proceed  to  stage  3,  we  repeat  our  cycle  so  that  the  prior 
distribution  of  0^  satisfies  the  condition 

03  sl  (@2  |  t2)  . 

If  condition  (2.16)  is  not  satisfied,  then  we  can,  following  Strategy  1 

of  Section  2.1,  ignore  the  inequality  (2.16)  and  proceed  directly  to  stage  3, 

dcf 

or  follow  Strategy  2  and  pool  and  T2  to  obtain  T^2  =*—  (T^  +  T0)/2  , 

jjg  J 

and  n^2  — >*  (n^  +  n2)/2  .  If  we  choose  to  pool,  then,  analogous  to  (2.7) 
and  (2.10),  we  must  have 


a2  +  T12  >  a0  +  T0  +  al  +  T12 
n12  1  80  +  "0  +  °12  ‘  1 


(2.17) 


> 
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A  sufficient  condition  for  the  above  is  that  a,  >_  +  Tq  +  a^  .  Thus, 

at  this  stage,  the  prior  parameter  a^  has  to  bear  a  relationship  to 
Tq  ,  the  total  time  on  test  at  stage  0. 

As  we  emphasized  in  Section  2.1,  the  effect  of  pooling  is  a  lowering 
of  the  posterior  mean  at  the  previous  stage.  In  the  present  case,  we 
have  changed  the  posterior  mean  at  stage  1  from  (otQ  +  Tq  +  a^  +  T^)/ 

(0q  +  Hq  +  n^  -  1)  (Equation  (2.14))  to 


(2.18)  E(01  |  Tq,T1,T2) 


a0  *  T0  *  al  *  T12 
80  +  n0  +  °12  ‘  1 


2 (ap  +  Tp  +  at)  +  Tx  +  T2 

2(Bq  +  nQ)  +  nL  +  n2  -  1 


Furthermore,  our  credibility  intervals  for  6^  will  now  be  given  by 

•WW 

/  *<9l  I  T0.Tl’T2i')<ie1  '  1  '  T 

(91  lT0-Tl-T2> 

where  g(0^  |  Tq.T^.T,)  is  an  inverted  gamma  distribution  with  a  scale 
parameter  (2(<1q  +  Tq  +  +  T^  +  T2)/2  and  a  shape  parameter 

(2(3q  +  nQ)  +  +  n2  ~  1) / 2  . 

Of  course,  our  Bayes  estimator  of  02  remains  unchanged  as 
(aQ  +  Tq  +  a^  +  T^  +  a2  +  T2)/(6q  +  ng  +  n1  +  n2  -  1)  . 

Since  we  have  revised  our  estimator  of  9^  from  that  given  by 
Equation  (2.14)  to  that  given  by  Equation  (2.18),  we  will  have  to  see  if 

(2.19)  (9^  |  Tq.T^T,,)  ^  (0q  |  Tq)  ,  if  we  did  not  have  to  pool  at  stage  1, 


or 

(2.19.1)  (9  j  Tq,T1,T2)  (9q  [  Tq.T^)  ,  if  we  had  to  pool  at  stage  2. 
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A  necessary  condition  for  (2.19)  is  that 


(2.20) 


a0  +  T0  +  al  +  T12  >  a0  +  T0 
0O  +  n0  +  n12  '  1  “  60  +  n0  " 


which  reduces  to  the  requirement  that 


(2.21) 


al  +  T12 


12 


aQ  +  T 


~  S0  +  no 


If  (2.21)  is  not  violated,  we  proceed  to  stage  3. 

If  (2.21)  is  violated,  then  we  shall  pool  Tq  and  and  n^  and 

n^  to  form 

T0,12  “  (T0  +  T12)/2  ’  and  n0,12  ""  (n0  +  n!2)/2  * 

and  replace  the  appropriate  quantities  in  (2.20)  by  their  pooled  values. 
Having  done  this,  we  shall  need  to  have 


(2.22) 


a0  *  T0,12  +  31  +  TQ .  12  >  a0  +  T0, 12 
60  +  n0,12  +  n0,12  '  1  “  S0  +  n0,12  -  1 


which  because  of  a^  >_  is  always  true. 

Since  TQ>12  »  j  (T0  +  j  (^  +  T2))  and  nQ^2  *  j  (nQ  +  j  ^  +  n2)|  , 
condition  (2.22)  reduces  to 


4a  +  2T  +  T  +  T 
0  0  12 


a0  +  T0  *  al  +  T12  _ 

60  +  n0  +  n12  '  1  “  4B0  +  2n0  +  nl  +  n2 


Thus, 

is  violated 


T2  is 


if  we  did  not  have  to  pool  at  stage  1,  and  if  condition  (2.21) 
,  our  Bayes  estimator  of  0q  conditioned  on  Tq  ,  T^  , 


and 
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(2.23) 


4a  +  2T  +  T.  +  T 

E(9q  I  T0,TrT2)  -  4g  +  2n.  +  n.  +  n0  - 


The  credibility  intervals  for  9^  are  now  given  by  an  inverted 
gamma  distribution  with  scale  parameter  (4a^  +  2Tq  +  +  T2)/4  and 

shape  parameter  (4gg  +  2n^  +  n^  +  n2)/4  •  We  can  now  either  stop  or 
proceed  to  stage  3. 

Reverting  to  Equation  (2.20),  we  note  that  a  necessary  condition 
for  satisfying  this  equation  is  that 


(2.24) 


a0  +  T0  +  al  +  T12 


2a0  +  T0  +  T1 


B0  +  no 


n12  1  260  +  n0  +  nl  ‘  1 


If  condition  (2.24)  is  satisfied,  we  proc  ad  to  stage  3.  Note  that 
for  n^  i  n2  condition  (2.24)  reduces  to 


(2.25) 


al  +  T12 


“0  +  Tl 


B0  +  n0  +  n12 


1  ~  26o  +  no  +  ni  ”  1  * 


note  that  when  n^  >_  n2  ,  2&q  +  nQ  +  nl  ~  1  +  n0  +  n12  _  ^  '  Clearly, 

condition  (2.25)  is  satisfied  whenever  T^2  _>  ,  that  is,  when  ^2  >  T1  ' 

Thus,  in  view  of  the  above  arguments,  whenever  condition  (2.24) 
is  violated,  that  is  whenever  n^  <  n2  or  T2  <  T^  ,  or  both,  we  shall 
replace  T^  and  n^  by  their  pooled  values  T^2  and  n^2  .  Thus, 
after  pooling,  Equation  (2.24)  becomes 


a0  +  T0  *  al  +  T12  >  4otO  +  2T0  *  T1  *  T2 
B0  +  n0  +  n12  '  1  1  4B0  +  2n0  +  n!  +  n2  ' 


which  because  of  a^  >_  c*q  is  always  true. 
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To  summarize,  if  we  had  to  pool  at  stage  1,  and  if  condition  (2.24) 
is  violated,  our  Bayes  estimator  of  9^  conditioned  on  Tq  ,  ,  and 

is 


E(8 


vvv 


4aQ  +  2TQ  +  Tx  +  T 
4B0  +  2nQ  +  nx  +  n2 


Note  that  its  estimator  is  identical  to  the  one  given  by  Equation  (2.23) 
which  was  based  on  the  fact  that  there  was  no  pooling  at  stage  1. 

However,  in  the  present  case,  the  credibility  intervals  for  6^ 
are  given  by  an  inverted  gamma  distribution  with  scale  parameters 
(AOq  +  2Tg  +  T^  +  T2)/2  and  shape  parameter  (46^  +  2n^  +  n^  +  . 

We  can  now  either  stop  or  proceed  to  stage  3. 

We  contrast  these,  to  the  credibility  intervals  for  0Q  given 
after  Equation  (2.23),  which  pertained  to  the  case  of  no  pooling  at 
stage  1.  We  note  that  the  pooling  at  stage  1  and  at  sta^e  0  has  a  tendency 
to  make  the  credibility  intervals  wider  than  those  obtained  when  there  is 
pooling  at  stage  0  only.  Thus,  based  cn  the  above  analysis ,  we  claim  that 
excessive  pooling  results  in  wider  credibility  intervals. 

Our  analysis  of  the  failure  data  at  the  succeeding  stages,  follows 
along  the  lines  mentioned  above. 

2.3  Some  Remarks  on  the  Pooling  Procedure 

It  is  fairly  clear  that  condition  (2.7)  is  likely  to  be  violated 
whenever  (T^/n^)  is  not  much  larger  than  (T^/n^)  .  Note  that  (T  /n  )  • 
1  *  0,1  ,  is  the  (non-Bayesian)  maximum  likelihood  estimator  of  9^  , 
i  •  0,1  .  Thus  (2.7)  will  be  violated  if  the  improvement  in  reliability 
in  going  from  stage  0  to  stage  1  is  not  significantly  large.  Thus, 
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pooling  will  be  necessary  whenever  the  effect  of  the  design  changes  is 
not  substantial  (or  if  the  design  changes  have  produced  a  significant 
deterioration) . 

The  pooling  procedure  advocated  by  us  is  one  among  several  others 
that  can  be  used.  For  example,  we  could  have  pooled  the  estimated  mean 
times  to  failure  (T^/ng)  and  (T^/n^)  ,  or  we  could  have  just  pooled 
the  observed  total  time  on  test  Tq  and  .  Irrespective  of  how  we 
pool,  the  important  question  here  is  whether  pooling  the  data  is  a  legitimate 
Bayesian  procedure. 

A  pure  and  orthodox  Bayesian  might  argue  that  by  pooling  we  have 
violated  the  "likelihood  principle"  of  statistical  inference.  He  will  take 
objections  on  the  grounds  that  our  decision  rule  is  not  based  on  the 
information  provided  to  us  by  the  true  posterior  distribution,  but  instead, 
is  based  on  a  posterior  distribution  which  is  modified  to  suit  our  hypo¬ 
thesis.  He  would  recommend  that  instead  of  pooling,  it  would  be  better  to 
choose  a^  >>  aQ  ,  so  that  condition  (2.7)  will  always  be  satisfied,  or 
to  choose  a  joint  prior  distribution  on  9^  and  9^  in  such  a  manner  that 
there  is  no  probability  mass  in  the  region  9^  <  9^  (as  has  been  done 
by  Barlow  et  al.  (1972)). 

Our  response  to  the  above  arguments  is  that  not  allowing  any  prior 
or  posterior  probability  in  the  region  9^  <  9^  is  too  strong,  and  perhaps 
an  unreasonable  requirement,  and  that  pooling  is  necessitated  by  the  ran¬ 
domness  of  the  data.  Thus,  whenever  the  posterior  distributions  violate 
our  requirement,  that  is,  (9^  |  T^)  (9^  |  T^)  ,  it  is  preferable 

to  pool  the  variables  rather  than  to  change  the  prior  parameters  in  order 
to  make  a^  >>  .  As  a  compromise,  we  may  want  to  delete  the  requirement 

that  9^  ^  9q  with  respect  to  the  posterior  distributions,  and  just  work 
with  the  requirement  that  (9^)  ^  (9q  [  Tq)  [see  Section  4]. 
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Another  major  comment  about  our  procedure  pertains  to  our  rational 
for  requiring  that  subsequent  to  pooling  conditions  of  the  type  given  by 
Equations  (2.11)  be  satisfied.  Note  that  (2.11)  is  analogous  in  appearance 
to  the  necessary  condition  (2.6.1).  However,  the  terms  which  comprise 
condition  (2.11)  are  not  the  means  of  the  true  posterior  distribution 
after  pooling.  For  instance,  after  we  replace  Tq  by  T  ^  ,  and 
by  ,  the  mean  of  the  posterior  distribution  of  6^  conditioned  on 

TQ1  is  not  (aQ  +  Tq^)/(6q  +  nQ^  -  1)  ,  as  is  implied  by  the  right  hand 
side  of  (2.11).  The  actual  mean  of  the  true  posterior  distribution 
is  quite  complicated,  and  is  given  by 


/  6is(V9i  I  Vd9i 

all  0 


where  8(0q>02  I  T^)  the  joint  posterior  distribution  of  0^  and 

8^^  ,  given  by 


6o)r(tloi 


61) 


1 


noi+so+1Qn 

0  ei 


01 


+8^+1 


2T 

01 

J 


J-0±Z  +  -*.) 

noi_1  noi_1  \  9o  9i  / 


dv 


(2TQ1  -  v)  v  e 


2T 

01 

/ 


(2Tq1  -  v)  01  v  01 


noi+9o  noi+9i 

0  (a0  +  2T01  -  v)  U(ax  +  v)  Ui  1 


dv 
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In  view  of  the  computational  difficulties  involved  with  the  above  equations, 
we  choose  (ct^  +  Tq1)/(6q  +  n^  -  1)  as  being  analogous  to  the  mean 
of  the  posterior  distribution  of  8^  given  .  We  approximate  the 

mean  of  the  posterior  distribution  of  8^  given  in  a  similar  manner, 

and  thus  write  condition  (2.11).  Since  the  above  approximations  have  been 
motivated  by  the  arguments  which  lead  us  to  pool,  we  feel  that  they  are 
inherently  satisfactory. 

We  should  close  this  section  by  stating  that  in  the  light  of  the 
above  discussions,  our  approach  should  be  called  a  "pseudo-Bayesian 


approach. " 
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3.  AN  ISOTONIC  REGRESSION  OF  THE  RAW  POSTERIOR  MEANS 

Our  Strategy  1  of  Section  2.1  specifies  that  the  inequality  (2.9), 
and  other  similar  inequalities  be  ignored  whenever  the  posterior  means 
do  not  have  the  correct  order.  As  a  result  of  the  above  strategy,  we 
will  have  at  the  end  of  testing  over  the  (t  +  1)  stages  the  (t  +  1) 
posterior  means 


E(0, 


V’E(91 


W’ 


E(e 


w 


V 


where 


E(0O  |  T0) 


*0  +  T0 


no  -  1  ’ 


and 


“0  +  T0  +  l  +  Tj) 

E^9i  I  W  •••»  Ti)  =  *  1  - 1,2 . T  • 

6o  +  no  +  l  nj  -  1 

j=0 


Under  our  postulate  of  reliability  growth,  we  would  need  to  have 
(as  a  necessary  condition) 


(3.1)  E(81  |  TQ,  ....  T.)  1E(0.+1  !  TQ . T.+1)  ,  i  =  0,1,  ....  T  -  1 


If  condition  (3.1)  is  satisfied,  then  our  Bayes  estimate  of  the 
reliability  growth  curve  is  given  by  these  posterior  means,  and  our  Bayes 
estimator  of  the  reliability  at  stage  t  ,  is  simply  E(@t  |  Tq,T^,  ...,  T^) 
Note  that  because  of  the  adaptive  nature  of  our  scheme,  £(9^  |  Tq,  ...»  T^) 


is  based  on  the  failure  data  over  all  the  previous  and  the  present  stages 


of  testing,  and  our  prior  knowledge  about  the  magnitude  of  the  improvement 
over  each  stage. 

If  condition  (3.1)  is  violated  by  any  one  or  more  of  the  indices 
i  ,  i  =  0,1,  ....  t  ,  then,  we  shall,  following  Barlow  et  al.  (1972)  pool 
the  adjacent  violators  to  obtain  the  isotonic  regression  of 
E(0i  |  TQ,  ....  Ti)  ,  i  =  0,  ....  t  ,  say,  E*(91  |  TQ ,  ...,  T.)  . 

*  I 

We  shall  use  the  E  (6^  j  T^,  ...,  T^)  ,  i  =  0,  ...,  t  as  our  estimate 
of  the  reliability  growth  and  E  (9t  |  TQ ,  ....  T  )  as  our  estimate  of 
the  reliability  at  stage  x  .  Note  that  like  E(8t  j  TQ,  ...,  T  )  , 

*  I 

E  (9^  j  Tq,  •••,  T^)  is  based  on  the  failure  data  over  all  the  previous 
stages,  our  prior  knowledge  about  the  magnitude  of  the  improvements  at 
each  stage,  and  the  postulate  of  reliability  growth. 

The  remarks  of  Section  2.3  are  also  appropriate  for  the  isotonic 

*  i 

regression  estimators  E  ( 0 ^  TQ,  ....  TJ  ,  since 

a)  by  performing  an  isotonic  regression  of  the  true  posterior 
means  we  have  violated  the  likelihood  principle,  and 

■k  . 

b)  the  estimators  E  (9^  |  TQ ,  ...,  TJ  not  being  the  true 
posterior  means  of  the  9^  ,  i  =  0,  ...,  x  ,  they  are  not 


fully  Bayesian. 


4.  ESTIMATION  WHEN  THE  ORDERING  IS  WITH  RESPECT  TO  THE  PRIORS  ONLY 


In  Section  2,  we  have  considered  the  case  when  the  mean  lifetimes 
were  stochastically  ordered  with  respect  to  both  the  prior  and  the  posterior 
distributions.  In  this  section,  we  shall  delete  the  requirement  that  the 
means  be  ordered  with  respect  to  the  posterior  distribution.  When  this  is 
done,  we  will  not  have  to  pool  the  violators,  nor  will  we  have  to  perform 
an  isotonic  regression  of  the  posterior  means,  should  we  choose  not  to 
pool . 

We  start  off  by  choosing  a  prior  distribution  of  9^  , 
as  given  by  Equation  (2.0).  The  posterior  distribution  of  0^  conditioned 
on  Tq  ,  g(9g  |  T0;a0, 60,nQ)  is  given  by  Equation  (2.1).  Assuming  a 
squared  error  loss,  the  Bayes  estimator  of  0^  is  E(0q  |  T^)  ,  and  this 
is  given  bv  Equation  (2.2);  the  credibility  intervals  for  0^  are  given 
by  Equation  (2.3)  . 

We  shall  now  choose  a  prior  distribution  of  gid^ja^.b^)  in  such 

a  manner  that  0^  ^  (0q  [  T^)  .  Following  the  discussion  of  Section  2, 
we  shall  choose  =>  +  T^  +  a^  and  =  0^  +  n^  ,  where  a^  has 

the  same  interpretation  as  in  Section  2.  If  at  stage  1  we  look  upon  T^ 
as  a  constant,  and  assume  that  g(0^;a^,0^)  is  independent  of 
g(0Q  |  ^o’aO’ ^0’110^  *  c*ien  un^er  the  assumption  of  a  squared  error  loss 
function,  the  Bayes  estimator  of  0^  ,  conditioned  on  Tj  is  E(0^  j  T^)  , 
given  by  Equation  (2.b).  The  posterior  distribution  of  given  T^  . 

g ( 0 1  |  T^;*)  is  given  by  Equation  (2.5),  and  the  credibility  intervals 
for  6^  follow  in  the  usual  manner.  Note  that  the  above  statements  are 
only  true  if  T^  is  viewed  as  a  constant  at  stage  l,  the  prior  distribution 
at  stage  1  is  assumed  to  be  independent  of  the  posterior  distribution 


at  stage  0. 
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Once  we  obtain  E(0^  |  T^)  we  do  not  care  to  compare  it  with 
E(60  |  Tp)  ,  since  we  have  not  imposed  any  requirements  on  our  parameters 
with  respect  to  posterior  distributions. 

We  now  proceed  to  stage  2  by  choosing  our  prior  distribution  of  62 
in  such  a  manner  that 


9 2  S£  !  V  . 

Following  our  discussion  in  Section  2,  we  shall  take  g(@2;ci2,02)  as 
our  prior  distribution  of  with  +  a^  +  +  a.^  ,  and 

®2  =  ^0  +  n0  +  nl  ’  here  again  we  shall  treat  TQ  and  as  constants. 

As  before,  if  g(02;a2*82^  is  taken  to  be  independent  of  g(9^  |  T^;«)  , 
then  the  mean  of  the  posterior  distribution  of  ©2  conditioned  on  T2 
is  our  Bayes  estimator  of  ©2  .  We  continue  in  this  manner  going  from 
one  stage  to  the  next,  obtaining  at  each  stage  the  Bayes  estimator  of 
0L  ,  i  =  3,  . . . ,  t  . 
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5.  SUMMARY  AND  CONCLUSIONS 

In  this  paper  we  have  considered  an  adaptive  approach  for  estimating 
reliability  growth  based  on  prior  information. 

In  Section  2  we  have  imposed  a  strong  requirement  on  our  approach, 
by  requiring  that  the  mean  times  to  failure  at  the  various  stages  be 
stochastically  ordered  with  respect  to  both  the  prior  and  the  posterior 
distributions.  The  latter  requirement  can  be  satisfied  if  we  pool  the 
violators;  however,  pooling  results  in  a  violation  of  the  likelihood 
principle,  and  other  computational  difficulties.  Even  though  the  com¬ 
putational  difficulties  can  be  avoided  by  using  some  approximations  (see 
Section  2.3),  the  pooling  makes  our  procedure  not  fully  Bayesian.  Thus, 
what  we  present  in  Section  2  can  best  be  described  as  a  Bayesian  scheme 
for  estimating  reliability  growth.  A  formal  investigation  of  the  properties 
of  our  scheme,  despite  the  fact  that  it  is  not  fully  Bayesian,  is  an  open 
question  which  we  hope  to  address  in  our  future  work.  Our  scheme  however, 
does  produce  results  which  are  reasonable  and  intuitively  satisfying. 

Our  review  of  the  literature  in  Bayesian  statistics  indicates  that 
there  is  no  discussion  or  even  mention  of  the  problem  estimating  parameters 
which  are  stochastically  ordered.  As  mentioned  before,  our  strategy  of 
pooling  the  violators  to  obtain  the  stochastic  order  may  be  unacceptable 
to  a  Bayesian.  We  therefore  hope  that  this  paper  can  stimulate  some  basic 
research  into  the  general  problem  area  mentioned  above. 

In  view  of  the  difficulties  mentioned  above,  we,  in  Section  4,  weaken 
the  specifications  on  our  approach  by  deleting  the  requirement  that  the 
parameters  be  stochastically  ordered  with  respect  to  the  posterior  dis¬ 
tributions.  This  simplification  obviates  the  need  for  pooling  the  violators. 
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and  thus  would  make  our  procedure  fully  Bayesian,  and  therefore  optimal  in 
the  usual  sense  of  minimizing  the  square  error  loss  function.  However,  the 
adaptive  nature  of  our  problem  imposes  certain  computational  difficulties. 
We  circumvent  these  by  treating  the  observed  statistic  T  to  be  constant 
at  stage  (i  +  1)  ,  i  -  0,1,2,  ...,  t  -  1  ,  and  by  assuming  the  prior 
distribution  at  stage  j  to  be  independent  of  the  posterior  distribution 
at  stage  j  -1  ,  j  =1,2,  ...,  r  .  Then,  within  the  context  of  the  above 
assumptions,  our  procedure  of  Section  k  is  fully  Bayesian. 

5.1  Future  Work 

There  are  several  other  aspects  of  the  reliability  growth  problem  that 
we  plan  to  address  in  our  subsequent  work.  These  are: 

i)  An  evaluation  of  the  gain  in  information  obtained  by  considering 
an  adaptive  scheme  wherein  previous  data  obtained  at  stages 
0,1,  . . . ,  i  -  1  ,  is  used  in  the  estimation  at  stage  i  ,  versus 
a  nonadaptive  scheme  'herein  only  the  data  at  stage  i  is  used. 
It  is  conceivable  that  an  adaptive  procedure  will  be  advantageous 
whenever  the  improvement  in  reliability  form  one  stage  to  another 
is  small,  whereas  if  there  is  a  drastic  change  in  reliability  at 
a  particular  stage,  then  the  data  from  the  previous  stages  will 
tend  to  diminish  its  true  effect, 
ii)  A  cost-benefit  analysis  of  the  reliability  growth  procedure. 

That  is,  we  would  like  to  evaluate  the  trade-off  between  the 
costs  incurred  in  improving  the  reliability  at  stage  i  versus 
the  actual  improvement  in  reliability  at  stage  (1  +  1)  say 
(0^+^  -  0^)  VO^  ,  i  ■  0,1,  ...,  t  .  It  is  conceivable 
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that  the  V0^  will  be  decreasing  in  i  (there  is  only  so 
much  that  one  can  do  to  improve  a  system)  whereas  the 
will  be  either  constant  or  increasing  in  i  .  What  we  need 
is  a  stopping  rule  which  tells  us  when  to  stop  performing 
the  improvements  on  the  system  and  put  the  system  into 
operation,  based  on  the  costs  and  out  best  estimate  of 


1 


27 


REFERENCES 


Balaban,  H.  (1978),  "Reliability  Growth  Models,"  Journal  of  Environmental 
Sciences,  pp.  11-18. 

Barlow,  R.  E. ,  D.  J.  Bartholomew,  J.  M.  Bremner  and  H.  D.  Brunk  (1972), 
STATISTICAL  INFERENCE  UNDER  ORDER  RESTRICTIONS,  John  Wiley  and 
Sons,  Inc.,  Publishers,  New  York. 

Smith,  A.  F.  M.  (1977),  "A  Bayesian  Note  on  Reliability  Growth  During 
a  Development  Testing  Program,"  IEEE  Transactions  on  Reliability, 
Vol.  R-26,  pp.  346-347. 

Weinrich,  M.  C.  and  A.  Gross  (1978),  "The  Barlow-Scheuer  Reliability 
Growth  Model  from  a  Bayesian  Point  of  View,"  Technometrics, 

Vol.  20,  No.  3,  pp.  249-254. 


